Bivariate Beta-LSTM

Long Short-Term Memory (LSTM) infers the long term dependency through a cell state maintained by the input and the forget gate structures, which models a gate output as a value in [0,1] through a sigmoid function. However, due to the graduality of the sigmoid function, the sigmoid gate is not flexible in representing multi-modality or skewness. Besides, the previous models lack modeling on the correlation between the gates, which would be a new method to adopt inductive bias for a relationship between previous and current input. This paper proposes a new gate structure with the bivariate Beta distribution. The proposed gate structure enables probabilistic modeling on the gates within the LSTM cell so that the modelers can customize the cell state flow with priors and distributions. Moreover, we theoretically show the higher upper bound of the gradient compared to the sigmoid function, and we empirically observed that the bivariate Beta distribution gate structure provides higher gradient values in training. We demonstrate the effectiveness of bivariate Beta gate structure on the sentence classification, image classification, polyphonic music modeling, and image caption generation.Comment: AAAI 202

Electrical spin injection and accumulation in CoFe/MgO/Ge contacts at room temperature

We first report the all-electrical spin injection and detection in CoFe/MgO/moderately doped n-Ge contact at room temperature (RT), employing threeterminal Hanle measurements. A sizable spin signal of ~170 k{\Omega} {\mu}m^2 has been observed at RT, and the analysis using a single-step tunneling model gives a spin lifetime of ~120 ps and a spin diffusion length of ~683 nm in Ge. The observed spin signal shows asymmetric bias and temperature dependences which are strongly related to the asymmetry of the tunneling process.Comment: 28 pages, 5 figure

Occipital nerve stimulation in a patient with an intractable chronic headache -A case report-

Occipital nerve stimulation (ONS) is a form of peripheral nerve stimulation used to treat refractory headaches. The trial of ONS was carried with the midline incision C1-2 level, inserted electrical lead subcutaneously to oblique and cephalad direction followed by trajectory of blunt dissection. We used 8 pole electrical lead to cover lesser occipital nerve, greater occipital nerve, third occipital nerve and great auricular nerve. We anchored the lead at the midline insertion site after confirming the stimulation of the patient. And then we looped and tightened the lead loosely, connected the lead and the extension under right supraspinatus muscle region. After 1 week trial period, we performed the permanent implantation of occipital nerve stimulator. We inserted internal pulse generator under a pocket located at right infraclavicular region. The VAS score dropped from 8/10 to 1-2/10. No serious complications were detected during 1 month follow-up

THE EFFECT OF 12-WEEK STRENGTH TRAINING ON GAIT CHARACTERISTICS IN ADOLESCENT WITH DOWN SYNDROME: A SINGLE CASE STUDY

It has been reported that approximately 80% of individuals with Down syndrome (DS) exhibit abnormal gait characteristics. They are exhibited by flat-footed contact with no heel-strike, excessive abduction of the leg in the swing phase, and abnormal knee and hip flexion throughout the gait cycle (Matteo, 2002). The purpose of this study was to examine the influence of a 12-week strength training program on the gait characteristics during walking by an adolescent with DS